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g : Abstract 

We discuss and quantify different possibilities to determine matter effects, the value and the 
sign of Am^, as well as the magnitude of sin 2 2# 13 in very long baseline neutrino oscillation 
experiments. We study neutrino oscillation at a neutrino factory in the — > disap- 
pearance and v e — > appearance channels with and without muon charge identification. 
One possibility is to analyze the v e — > appearance channels leading to wrong sign muon 
events, which requires however very good muon charge identification. Without charge iden- 
tification it is still possible to operate the neutrino factory both with \i~ and /i + beams and 
to analyze the differences in the total neutrino event rate spectra. We show that this leads 
already to a quite good sensitivity, which may be important if right sign charge rejection 
capabilities are insufficient. With muon charge identification one can study the — > 
disappearance and the v e — > appearance channels independently. The best method is 
finally achieved by combining all available information of the — ► disappearance and 
- * appearance channels with charge identification and we show the sensitivity which 
can be achieved. 
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1 Introduction 



Proposed neutrino factories 0, |3], |, |5| offer unique possibilities to improve the knowledge 
about neutrino masses, leptonic mixings and CP violation. The leptonic sector is not plagued 
by hadronic uncertainties such that vacuum neutrino oscillation allows to determine many 
parameters quite precisely. Vacuum neutrino oscillation is however only sensitive to mass 
squared differences thus the sign of Am^ can not be determined allowing therefore at 
the moment different scenarios for the ordering of mass eigenvalues. It has however been 
pointed out recently || 0, || that the sign of Am^ can be determined from the v e — > z/ M 
and v e — > appearance rates via matter effects |9j in very long baseline neutrino oscillation 
experiments at neutrino factories. We discuss and quantify in this paper further possibilities 
to determine the sign of Am^ via matter effects and sin 2 2#i3 by considering the appearance 
channels and/or the z/ M —> and P M — > z/ M disappearance channels in different scenarios 
with and without muon charge identification. Altogether there are four possibilities. First, 
without charge identification one can not study wrong sign muon events (i.e. the appearance 
channels), but one can operate a neutrino factory already both with fi~ and fi + beams and 
analyze the differences in the combined muon neutrino and antineutrino event rate spectrum. 
This is useful if charge identification is not available or not operative in an initial stage of the 
experiment. We show that this leads already to a quite good sensitivity since the effects in 
the combined appearance and disappearance channels are for a baseline of 7332 km about 
the same size and go in the same direction. Next, with muon charge identification, one 
can study the — > disappearance and the v e — > appearance channels separately. 
For a baseline between 2800 km and 7332 km we find that the significance of these result 
is essentially unchanged compared to 7332 km. The point is that the total event rates 
decrease slower than the vacuum rates leading for a large range to a statistically constant 
result. We use therefore in this paper mostly a baseline of 7332 km since for this larger 
baseline there is further information in the disappearance channels. A third option would be 
to use the disappearance channel alone, this provides however not much extra information. 
Last, the best method is achieved with muon charge identification by combining all available 
information of the — > disappearance and v e — > appearance channels. We show for 
our baseline of 7332 km the sensitivity which can be achieved. 

The basic effect which allows to extract the sign of Am^ comes from coherent forward 
scattering of electron neutrinos in matter which leads to effective masses and mixings dif- 
ferent from vacuum. We will discuss in this paper a full three neutrino framework in the 
limit where the small solar mass splitting can be neglected in vacuum, i.e. Ato^ = 0. This 
degeneracy is however destroyed in matter and we need therefore a full three neutrino de- 
scription. The basic mechanism which allows the extraction of the sign of Am 2 via matter 
effects can, however, already be seen in a simplified 2x2 picture with two mass eigenvalues 
m;, to,, Am 2 = m) - to 2 and one mixing angle 9 only. 
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One obtains then the well known relations for the parameters in matter 



Am 2 m = Am 2 C± = Am 2 W f t cos 20^ ± sin 2 26 ; sin 2 26 m = sin 2 26 ■ Cg 2 , (1) 



where the neutrino energy E enters via the matter term 

A ^ 2EV=± 2V2G I Y £ E 

The sign of the matter term A is for electron neutrinos (antineutrinos) traveling inside 
the earth positive (negative) and leads thus to different corrections for neutrinos (C+) and 
antineutrinos (C_). Matter effects modify the 2x2 vacuum transition probabilities 

P(ui — > Vj) = sin 2 26 ■ sin 2 ( — — — j and P{y%j —> v%J) = 1 — P{y% —> v j) , (3) 

since in matter one must replace sin 2 26 — > sin 2 26 m and Am 2 — > Aw? m . The matter cor- 
rections in eq. ([I]) depend for a given neutrino species (i.e. given A) clearly on the sign of 
Am 2 allowing thus in principle an extraction of this sign. One could, for example, compare 
neutrinos with antineutrinos, since the matter corrections go then in opposite direction in- 
ducing an asymmetry. The biggest matter effects (and therefore the best sensitivity to the 
sign of Am 2 ) occur when eq. ([[]) becomes "resonant" for 

A = Am 2 cos 26 . (4) 

This condition can be fulfilled for a given sign of Am 2 either for neutrinos or for antineu- 
trinos at a specific resonance energy, but optimization will be more complicated in a real 
experiment with an energy spectrum and other free parameters. Nevertheless eq. @) leads 
already to a rough approximation for a "optimal mean neutrino energy". In earth eq. (|]) 
gives for small 6, i.e. for cos 26 = 1 roughly the relation 

i.e. an optimal energy of about 15 GeV in the crust of the earth with an average effective 
density (p) ~ 2.8 g/cm 3 going down to about 10 GeV for paths crossing the earth at a 
distance of 7332 km with (p) ~ 4.2 g/cm 3 . 

Our paper is organized as follows. First we develop in section ||] analytic expressions for 
neutrino oscillations in matter in a suitable approximation. In section ^| we describe the 
experimental framework on which our numerical results are based. Section f| describes the 
effects of matter on the total rates and the used statistical methods are outlined in chapter ||]. 
Section |^ contains our results on the sensitivity to the magnitude and sign of Am 2 x and for 
sin 2 20i3. 
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2 Analytic Description of three Neutrino Mixing in Matter 



The mixing of three neutrinos can be described via 

3 



h > = ?Uik\vk > , i 



e, //, r, 



(6) 



fc=i 



where \v\ > corresponds to the neutrino flavour state v\ and \uf- > corresponds to the 
neutrino mass eigenstate Uk with eigenvalues mk, rnj. ^ rrij, k ^ j = 1,2,3. U is a 3 x 3 
unitary leptonic mixing matrix which we parameterize as 
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(7) 



where c,- 



cos 6ij and 



lj — ca.ij.vj. oij — Sill 6ij. The mixing matrix contains in general further CP- 

violation phases which do not enter in neutrino oscillation and are therefore not specified 
[PUfl . The angles are assumed to be in the ranges < 6*12, 6*23, #13 < 7r/2, < 5 < 2n. 
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Figure 1: Two mass ordering schemes determined by the sign of Am^. 

The squared mass splittings Am 2 = m 2 — m 2 show the hierarchy Am^ <C [Am^l as 
discussed in more detail below and allow for Am 2 21 < l(T 4 eV 2 , £ > 1 GeV and L < 10 4 km 
the approximation where Am^ = in vacuum. We have thus two almost degenerate mass 
eigenvalues and for Am^ > (Am^ < 0) these almost degenerate eigenvalues mi and ni2 
are lighter (heavier) than m 3 (see fig. [I]). The usual oscillation formulas depend only on 
Am| x and it is thus impossible to discriminate between the two schemes. Matter effects and 
CP-violating effects can lift this degeneracy in future measurements in very long baseline 
experiments. 

We can assume therefore for the following discussion that there is only one non-vanishing 
quadratic mass splitting Am 2 2 = Am^ = Am 2 in vacuum. To understand this case in 
matter we can write the mixing matrix eq. (0) as a sequence of rotations U = R{92 3 ) • 
R(0i 3 ) ■ R(8\2) where the CP-phase 5 is included in eq. (0) by a complex rotation in 13- 
subspace, i.e. by replacing s 13 — > Si 3 e~ lS . Alternatively the CP-phase could be included 
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by making any of the three rotations complex. This becomes useful when we write the full 
Hamiltonian in matter with the help of U in flavour basisQ 
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Here use has been made of the fact R^Ou), which operates in 12-subspace, drops out in 
the limit where Am^ = 0. Since we could use a convention where the CP-phase would be 
defined by a complex rotation in 12-subspace we can immediately see that the CP-phase 
drops out as well. Furthermore ^(#23) operates in the 23-subspace and commutes therefore 
with the matter term. We see that matter effects are confined in eq. (|8p inside the square 
brackets, which implies that matter affects in the Am^ = limit only the 13-subspace. 
We can readily use the standard two neutrino parameter mapping given in eqs. (H) for the 
13-subspace and obtain in matter Am 2 lm = Am 2 C± and sin 2 29 m = sin 2 29/C±, where 
Am 2 = Amj! enters into C + defined in eq. |]. Note, however, that Am 2 2 and Am^ become 
in matter in this way also energy dependent, namely 

a 2 A 2 n , Am 2 (C ± + 1) + A 2 2 Am 2 (C ± - I) - A 
A ^32,m = AmC ± = ; Am 21m = Am C ± = . 

(9) 

An important consequence is that the mass degeneracy between the first two eigenvalues is 
destroyed in matter. Thus even if we can approximate Am 21 = in vacuum we need for 
oscillation in matter the full three neutrino oscillation formulae. The only simplification left 
is that one can set in the mixing matrix 812 = and 5 = 0. 

These matter induced parameter mappings must now be inserted into the oscillation for- 
mulae for three neutrinos. Defining as shorthands D a b = e~ tEat 5 a b, J 1 ™ '■= UuU^U mi U m j 
and Aij := Amf^L/AE the transition probabilities P{yi —> v m ) from flavour I to flavour m 
in vacuum can be written as 



P{vi -+v m ) = \ {l\UDU + \m)\ 2 = 5 lm -4:J2 Re 4™ sin2 A y _ 2 Yl lmJ tT sin 2Ai i ■ ( 10 ) 



|2 

= di m — 4 

i>3 i>3 

As described above we can set in matter #12 = and 5 = resulting in 

P{Vfi <-> v e ) = sin 2 ^23 sin 2 2^13 sin 2 (A31) , (11a 
PW <-> v„) = 1 - sin 2 2^3 sin 2 13 sin 2 (A 2 i) - sin 4 6 23 sin 2 26 13 sin 2 (A 31 ) 

,2o/i „ 2 a ™2 



- sin 2 2fl 23 cos 2 13 sin 2 (A 32 ) , (lib) 
Pivp <-> v T ) = sin 2 2023 



sin 2 9 13 sin 2 (A 2 i) - ^ sin 2 2# 13 sin 2 (A 31 ) 



+ cos 2 13 sin 2 (A 3 2)J • (11c) 

To describe oscillation in matter we must insert into these formulae the parameter mappings 
discussed above, namely the shifted mass eigenvalues (Am§ lm = Am 2 C± and eqs. (|S|)) 

*A constant common neutrino mass can be separated leading to an overall phase. 
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and the shifted 13-mixing angle, sin 2 2#i3 jm = sin 2 2#i3 jC±. Note that the relations for 
antineutrinos are only formally identical due to the opposite sign of the matter term A 
in eq. ([[]). In vacuum the relations (]TT|a)-(|rT|c) could be further simplified since the tight 
CHOOZ results can be taken into account. For typically allowed Am^ values one 
has sin 2 2^13 ^ 0.1, while this upper limit is less stringent for 1.0 x 10~ 3 eV 2 < jAm 2 ^ < 
3.0 x 10~ 3 eV 2 where values of sin 2 2#i3 ~ 0.2 are allowed. Note however that the effective 
sin 2 2(9 13 in matter can be much bigger when the resonance condition is fulfilled such that 
further simplifications of eqs. (|IT|a)-(|TT|c) are potentially dangerous. 



3 Experimental Framework 



We use for our study a standard earth matter density profile |L2], [L3[ and we will treat 
neutrino oscillations in earth by a constant density approximation along each neutrino 
path. The varying matter profile of the earth implies that the average density is still path 
dependent. It has been shown recently [13, |T3| that this approximation works very well, 
while a constant density for all paths ignores even the mean density variations in the earth 
and has sizable errors|. We avoid the core of the earth and take in our study distances 
up to 7332 km. We assume furthermore a neutrino factory which can operate with or 
fi + beams leading to + v e or + v e neutrino beams resulting from N „± muon decays. 
The detector with N^t kilotons is assumed to be able to measure muons above an assumed 
threshold of 5 GeV [16| with an efficiency e^. The muons may come from the dominant 
Vfj, — > Pfj, disappearance channel or from the subdominant v e — > appearance channel with 
or without charge identification. Muons coming from the subdominant — > v T or v e — > v T 
channels with the r decaying subsequently to a muon should not be a problem, since they can 
be separated by kinematical means without loosing too much muon detection efficiency ||. 
The inclusion of various other potential backgrounds and detector properties will have some 
influence on the analysis, but with current understanding this would only result in moderate 



corrections. More detailed simulations of backgrounds are still in progress [|1£], [17], [18], [19 
Most limitations due to backgrounds and statistics can however be overcome by increasing 
the number of muon decays and/or the size of the detector. We do not include a detailed 
simulation of background effects at the moment. 

For three neutrinos there is only room for two independent quadratic mass splittings while 
there are three different results for oscillation. Among these the LSND evidence |2tJ for 
oscillation is most controversial and we omit this result therefore in our analysis, while we 
take the atmospheric result (mostly from SuperKamiokande and the solar neutrino 
deficit (mostly from GALLEX P2"| ) as evidence for oscillation. These results can be studied 
in a simplified 2x2 oscillation picture where the mixing matrix contains only one mixing angle 
9 with the two flavour transition probabilities in vacuum given in eq. (0). The dominant 
atmospheric «-> u T oscillations imply in this picture a mass splitting |23 



10~ 3 eV 2 ^ | Am 2 ! | <> 8.0 x 10" 3 eV 2 , (12) 



2 Note also that care should be taken about the core of the earth. Either one should avoid paths passing 
the core or one should take core effects into account. Specific core effects become however small when the 
oscillation wavelength becomes bigger than the size of the core. 
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while the solar neutrino deficit leads to different solutions [24] for Am| 1; all with [Am 2 ,^ 
\Am 2 31 



These are the solar vacuum oscillation (VO) solution and the large and small 
mixing angle (LMA and SMA) solar MSW solutions. The above assignment implies thus 



that Amjj dominates the atmospheric 



v T oscillation, while Am 2 ,-, is most relevant for 



the VO, SMA MSW and LMA MSW solution of the solar neutrino problem. We will see 
that our study depends only on Am| x such that in a very good approximation Am^ can 
be set to zero. We use therefore as default initial parameters of our study 



|Am^| 



3.5-10" 



\Am 2 21 \ 



; sin 2 26 



23 



1.0 



(13) 



and we will discuss variations of these parameters within the allowed ranges. 

The event rates of our results depend only on the combination N^±N^e^ and we take 
for both polarities A^iA^x^ = 2 • 10 21 . This corresponds for example to a setup with 
= 2 • 10 20 /i + decays, N^- = 2 • 10 20 /i~ decays, an A^t = 10 kt iron detector and a muon 
detection efficiency e u = 1. Unless otherwise mentioned we use a baseline of L = 7332 km. 

Our analysis is performed at the level of total and differential event rates. We include 
therefore the charged current neutrino cross sections per nucleon in the detector and the 
normalized v u + v e and v a + v e beam spectra g Ui of the neutrino factory |]J 



a Vfl (E) = 0.67 ■ lO^EcmVGeV 
9vA x ) = 9ve( x ) = 12a; 2 (1 - x) , 



cr Pfi (E) = 0.34 • 10- 38 £cm 2 /GeV 
g Vfl (x) = g Dfi (x) = 2x 2 (3 - 2x) , 



(14a) 
(14b) 



where x = E/E u . For a given number of useful muon decays N^±, detector size A^x, 
efficiency e u one obtains for the channel " i" (where i stands for a proper index uniquely given 
by the polarity of the muon beam and the considered oscillation channel) the contributions 
to the differential event rates 



drii 
dE 



N u iN kT e, 



10 9 N A 
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(15) 



where 10 9 A^ is the number of nucleons per kiloton in the detector and Pi stands for the rel- 
evant oscillation probability in matter as discussed above. In cases where different channels 
contribute the total differential rates are given by the sum of all individual terms. Total 
rates are obtained by integrating these differential rates from the threshold at 5 GeV to the 
maximal possible neutrino energy E n . 

To understand the event rates we look at the three terms in square brackets on the rhs. of 



eqs. (15). The first term contains overall factors which are constant in energy, which is only 
important for the proper event rate normalization. The second term is simply the product of 
flux times detection cross section which has to be folded with the third term, the oscillation 
probability in matter. The second term grows initially like E 3 and reaches a maximum 
before it goes to zero at E — E^. An important feature of the second term is that the 
low energy part is not changed when the muon energy is increased. This implies in a good 
approximation that the increase in the total event rates by increasing E^ comes essentially 
from the high energy tail of the spectrum only. This has also the important consequence that 
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experimental results for a lower muon beam energy E' < can in principle be obtained 
to a good approximation at higher energies by simply removing events with energies above 

K- 

4 Total Rates 

The analytic description above allows now an understanding of the event rates which we 
calculated numerically and which are presented below in fig. ||]. To understand first the total 
disappearance rates without matter one must look at the folding of the vacuum oscillation 
probabilities with the flux factor in eq. fll5|) . The oscillatory terms in the oscillation prob- 
abilities eqs. (JlQ|), namely the sin 2 Ay factors, depend then for fixed Am| x = Am 2 only 
on E/L. The oscillatory behavior vanishes for E/L — > oo and the first maximum of the 
vacuum oscillation occurs for given L at an energy Ei = 2Am 2 L/7i. This means that there 
will essentially be no effects of oscillation in the total disappearance rates when E\ is much 
smaller than the neutrino energy E. Since the event rates are dominated by the maximum 
of the flux factor close to E^ we can set E ~ E^ and find no oscillation effects when E^ is 
much larger than E\. The overall rates will however still decrease with the muon energy E^ 
according to the cross sections and fluxes approximately like E 2 as long as E^ is sufficiently 
larger than the muon threshold energy of 5 GeV. The first effects of vacuum oscillation 
show up for lower beam energies when E ~ E^ is decreased such that E^ = 0{E\). The 
oscillation becomes maximal for E^ ~ E\ while it vanishes again for E^ ~ E\/2. The effects 
of oscillation can be seen in the total rates as a dip in the overall E 2 scaling. For lower 
beam energies there are in principle further dips due to all other oscillation maxima, but 
this is on our case below the threshold energy of 5 GeV. 

In order to understand how matter effects influence the disappearance rates one must com- 
pare the matter "resonance energy" E opt in eq. @ at roughly 10 — 15 GeV with E\ and 
Efj, ~ E. At neutrino energies which are not close to this resonance energy the mixing 
sin 2 2#i3 i?n approaches quickly its value in vacuum, which is small. One can see immediately 
from the Hamiltonian in eq. (H) that the dominant — > v T oscillation decouples in the limit 
where sin 2 2# 13 = from the matter effects coming from the first generation such that it is 
clear that matter effects should be rather localized around the resonance region^. 

The total appearance rates are given for E^ 3> E\ by the asymptotic behavior of eq. (|TT|a) 
weighted with the flux. The increase in the rates with E^ comes again predominantly 
from the increased flux at energies close to E^ such that we need to look again in a good 
approximation at the asymptotic behaviour of E^Piv^ <-> u e ). Expanding E^Piv^ «-> u e ) 
in powers of 1/E, and using the fact that V ■ L is numerically small, one finds for the 
asymptotic appearance rates for small sin 2 2# 13 

2n 2 «„ ,a 2,2r2f (Am 2 ) 2 L 4 \ 4(Am 2 ) 3 L 4 V , , 

n oc sin 2 e 23 sin 2 2^ 13 (Am 2 ) 2 L 2 [l - 1 ^ 2 J + • (16) 

The result shows that the rates approach for E„ 3> E\ in vacuum a constant which depends 



3 Note that the mass splittings Amfj behave non-trivial in the high energy limit such that the asymptotic 
properties of eq. (|lTp) have to be evaluated carefully to reach the same conclusion. 
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only on even powers of Am 2 . The leading corrections to this constant fall like 1/E 2 . Turning 
on matter effects leads in eq. ([16|) to the third term which falls only like 1/E^ and which 
depends on (Am 2 ) 3 , i.e. on the sign of Am^. This induces in our case a matter dependent 
splitting in the appearance rates which is less localized in energy than the matter effects in 
the disappearance channels. There are thus significant effects even for beam energies which 
are somewhat away from the resonance energy. Note, however, that the discussion of effects 
is much more complicated for muon energies of the order or smaller than E\. 

This understanding of matter effects can now be compared with the results of our full 
numerical calculations. The following figures for the total rates in the different oscillation 
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Figure 2: Muon appearance rates v e — > and v e — > (dotted) and muon disappearance 
rates — > and — > (solid) as a function of the muon beam energy for a baseline 
of 7332 km, jAm^l = 3.5 ■ 10~ 3 eV 2 and sin 2 26 l 13 = 0.1. © and indicate positive and 
negative mass squared difference, indicates no oscillation rates. • and o label the neutrino 
and the antineutrino channels. 

lines) as well as the and — > disappearance rates (solid lines) on a logarithmic 

scale for maximal sin 2 26*13 = 0.1. These rates are in agreement with the results obtained 
recently by Barger et. al 0. The lines appear in pairs of neutrino (•) and antineutrino 
(o) channels which differ roughly by a factor two coming from the cross sections eqs. (|H]). 
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Fig. shows the cases with positive Am 



negative Am^ (0) and no oscillation (©). 



The asymmetry between © and in the appearance rates, which has been used to extract 
the sign of Am^ at smaller baseline |25|, is clearly visible. Note that there are also 
comparable matter effects in the disappearance channels at these large baselines, which 
appear only to be smaller due to the logarithmic scale. Fig. |2| shows clearly the important 
feature that the matter effects in the combined appearance and disappearance muon rates 
go for a neutrino factory with either + u e or + v e beams in the same direction. This 
opens an interesting possibility if muon charge identification is not available to separate 
the appearance channels (wrong sign muon events) from the disappearance channels (right 
sign muon events). It is then still possible to measure all muons, i.e. muons with both 
charges, or in other words the combination of the two oscillation channels, where matter 
effects add up. The resulting total muon rates of the combined channels are shown for 
both \l~ and /i + beams in fig. |3] on a linear scale for \x~ and fi + muon beams. The figure 



shows the sizable matter induced splittings in the total muon-neutrino rates 



for 



the mixing angles sin 29^ = (0.1, 0.04, 0.01). The difference between the two signs of Am^ 
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Figure 3: Total muon rates + (i.e. — > combined with v e —>■ and — > z/ M 
combined with v e — > v^) as a function of the muon beam energy for a baseline of 7332 km, 
lAmfiJ = 3.5- 10~ 3 eV 2 and N^NkT^n = 2- 10 21 which corresponds typically to a 10 kt-year. 
The different line types stand for different mixing angles 9 13 (see labels). © and indicate 
positive and negative mass squared difference. 
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influences the total rates up to a factor two or more. The effect comes partly from the 
appearance rates and partly from the disappearance rates, but always from the resonant 
channel. This is for positive Am^ the neutrino component of the beam and for negative 
Amgj the antineutrino component. For /i + beams the interplay of the two channels is 
as follows^: For positive Am^ the v e — > appearance channel is resonant leading to an 
enhancement of the combined rate, while matter corrections are moderate for the — > 
disappearance channel. For negative Am^, on the other side, the disappearance channel 
v y. — ► shows a resonant transition of to v e resulting in a suppression of the total 
Ufj, + Up rate, while the v e —>■ appearance rates are mostly unchanged. The combination of 
appearance and disappearance channels amplifies thus always the signal. This shows that 
an analysis of the combined appearance and disappearance channels is interesting and it 
may be especially important if the separation of right and wrong sign muon events is not 
available. Figure (| shows the corresponding differential event rate spectrum of the + z/ M 
induced muon rate over twenty energy bins for a mixing angle sin 2 2# 13 = 0.1 (CHOOZ 
bound). We find that the different matter effects have no specific spectral features which 
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Figure 4: Spectral distribution of the muon rates + according to fig. [| for sin 2 2# 13 = 
0.1. The left plot was done for negative stored muons, the right plot for positive muons. We 
use 20 energy bins over the range from 5 GeV to 20 GeV. 

could be used as a basis for cuts in order to amplify the signal relative to the oscillation 
signal. We will fit therefore in the following differential event rate spectra of data simulated 
with certain initial parameters and with statistical noise added. We will show how well these 
parameters can be re-extracted in an appropriate statistical way. We provide therefore in 
the next section information about the used statistical procedures and we will study then 
in more detail the statistical significance of the matter effects in the appearance channels, 
disappearance channels and combinations thereof. We focus on the potential to extract #13, 
the sign of Am^ and to test matter effects. 

4 For fi" beams holds the same for a reversed sign of Amjj. 



10 



5 Statistical Methods and Data Evaluation 



We numerically simulate data for a given parameter set (E^, Am^, sin 2 2# 23 , sin 2 2# 13 ) and 
add Poisson distributed fluctuations to the energy bins. The analysis of these "data" is done 
according to the procedure proposed by the Particle Data Book P5j for Poisson distributed 
quantities. Confidence levels (CL) are calculated by using 

n / obs \ 

X 2 = E 2 K h - < bS ] + 2 < bs log \) ■ (17) 
i=i v / 

We assume symmetric operation of the neutrino factory in both polarities, i.e. fi + and fi~ 
beams together with a detector such that N^+N^e^ = N^-N^e^ = 2 • 10 21 . The total x 2 
is given by 

X 2 = Xl + + Xl- • (18) 

If there is no charge identification then rii = (n M +)j + is the total (indistinguishable) 

number of and induced muon events in the i-th energy bin and obs and th label 
the observed (i.e. simulated) and theoretical predicted muon event rates. With charge 
separation we calculate x\± separately for neutrinos and antineutrinos and use the sum 

X 2 = Xl~,u + xl-,v + xl+, u + xl+,v ■ (19) 

Next x 2 is minimized as usual with respect to the parameters shown in the plots. We 
subtract the minimum value of \ 2 and define confidence levels according to the values of 

Ax 2 = X 2 ~ Xlin (20) 

This Ax 2 obeys a x 2 distribution for k degrees of freedom (i.e. the number of parameters 
fitted). The value of Ax^ L which corresponds to a given confidence level CL is given by: 

CL= / k - dx (21) 

Jo 2fr(§) 

For two degrees of freedom (la, 2a, 3a) corresponds to CL = (68.3%, 95.5%, 99.7%) and to 
A X 2 CL = (2.3, 6.2, 11.8), as usual. 

We use in our analysis for the interval between 5 GeV and 20 GeV a total of 20 bins. We 
checked that the statistical significance of the results does not change much by changing 
the number of bins, as long as one has enough bins to describe the spectral information 
sufficiently. Finer binning does thus not improve the significance due to the statistical 
limitation by fluctuations. In this sense it is best to use around 20 energy bins which should 
not be a problem with the usual energy resolution of detectors. 

6 Results 

As outlined above, we simulate a measurement with certain input parameters including 
statistical fluctuations for a given sign of Am^. Then we try to fit this dataset, i.e. we re- 
extract the input parameters both with the right and the wrong sign of Am^ . Instead of a 
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global fit to all parameters one can first fit the magnitude of [Am^l and sin 2 2#23 with good 
precision (a few percent ||) by analyzing the muon spectrum for the dominant — > and 
V/j, — > Vfi disappearance oscillation?]. The following plots assume that this analysis is done 
and we analyze then with sin 2 2# 2 3 fixed the matter induced effects and extract sin 2 2# 13 and 
the sign of Am^. We will see that this works very well if the mixing angle #13 is not too 
small. The value of A% 2 for the wrong sign of Am^ will tell us the confidence level at which 
we can reject the incorrect sign of Am^. For the right sign we can calculate confidence 
level contour lines from which we can read off the sensitivity for the determination of the 
relevant oscillation parameters. The A% 2 values printed in the following figs. |^ - [7] next to 
the CL contour lines are for the wrong sign of Am^ relative to the best fit with the correct 
sign of Am^. This are in figure |5| the values of the global minima with the wrong sign. In 
the other two figures we used the information on lAmSy from the fit in the sin 2 2#23-|Am 2 1 | 
plane to reject Am^ values which are inconsistent with the jAm^l value obtained before. 
We therefore restrict the fit for the wrong sign of Am^ to the local minimum of \ 2 m the 
neighborhood of the best fit of lAm 2 ^. 

Fig. [5] shows the la and 2a contour lines of the right sign fit for different jAm^l and different 
813 in the case with no charge separation (i.e. muons of either charge coming from or 
u^). With decreasing #13, the precision in the determination of sin 2 2#i3 gets worse, but this 
method allows to determine sin 2 28 13 already down to values of order 0(1CT 2 ) (see also fig. |8| 
and discussion). Since the fitted spectrum includes the dominant disappearance channel, 
quite a good precision can be obtained also for jAm 2 ^. 

Charge separation capabilities improve the sensitivity for sin 2 2# 13 . This is shown in fig. |6], 
which shows the results of a fit to the appearance channel only (wrong sign muon events). 
In this case, which does not include the disappearance events in the analysis, one looses of 
course precision in finding the right value of | Am| x | . The precision for | Am| x | can of course 
be improved in this case by a separate analysis of the disappearance spectrum ||. Fig. || 
shows that charge identification improves the precision in the determination of sin 2 2# 13 for 
small values of sin 2 26*13 an d the sensitivity will go down to values of order 0(1CT 3 — 1CT 4 ). 
Note, however, that for not too small mixing angles sin 2 2#i3 of about one magnitude below 
the current CHOOZ constraint, we find that the sum-rates without charge identification 
provide at least an equally well suited possibility to extract the value of sm 2 26 Vi . The 
determination of the sign of Am^ is always better in the appearance channel, but note that 
the sum-rates give also quite good confidence levels for not too small mixing angles #13. 

If charge identification is available then there is however an even better strategy by combin- 
ing all available information, i.e. a global fit to the matter effects of both the appearance 
and disappearance channels. The results of this fit are shown in fig. [7[ Now high precision 
is obtained both for # 13 and in the determination of Am^. 

The presented fits were all done with a fixed mixing angle sin 2 2#23 = 1 and it is in principle 
no problem to perform a full three parameter fit for Am| 1; sin 2 2# 13 and sin 2 26*23- The 
contour lines of our fits have to be extended into the third sin 2 2# 2 3 dimension and the 
precision is roughly given by the results in ref. ||. As explained above in the analytic 

5 One could combine the differential event rates coming from the /i + and [i~ beams, weighted to cor- 
rect for the cross section differences, such that the matter dependence is almost removed. This allows a 
determination of lAm 2 ^ and sin 2 2# 2 3 which is essentially independent of the sign of Ato^ and sin 2 26*i 3 . 
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Figure 5: Fit to the muon neutrino spectrum without charge identification (i.e. the sum of 
unoscillated (v^ — > v^) and oscillated (v e — > z^J muon neutrinos) for Am^ > at a baseline 
of 7332 km. Shown are the la and 2a contours. The rectangles denote the parameter pair 
for which the data were generated and the stars denote the obtained best fit. The numbers 
printed next to each case are the values of x 2 V er % d.o.ffor the best fit with the wrong sign 
ofAm 2 31 . 



discussion, there is no need to include further parameters like Am^ and the CP-phase S as 
long as the LMA MSW solution is not realized with a value of Am^ close to its current 



upper limit of order O(10 ) P7|, g^, 28, 29. 30. 31]. If this scenario were however realized 



such that CP-effects play a role, then this would be another reason to go for measurements 
based on matter effects to largest possible baselines like 7332 km. The point is that the 
relative magnitude of effects coming from Am^ 7^ and S decrease for longer baselines 
|25| . Such a scenario would however also enable a measurement of the CP violating effects 
at shorter baselines such that two experiments, one at a large baseline (for matter effects) 
and another a shorter baseline (say 2800 km for CP violating effects) would be ideal. 

Fig. [8] shows finally the region of the Am^-sin 2 2#i3 parameter space where a determination 
of the sign of Am^ will be possible. Shown are the la, 2a and 3a contour lines of a fit 
with the wrong sign of Am^ for positive Am^ (left plot) and negative Am| x (right plot). 
For positive Am^ the cross section favored neutrino channels show resonant matter effects 
whereas for negative Am^ the cross section disfavored antineutrino channels are resonant. 
Thus in the case of positive Am^ the confidence level at which the wrong sign can be 
excluded is slightly better. The dotted lines show the limits which can be obtained with 
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Figure 6: Fit to the muon neutrino appearance (v e — > v^) spectrum with charge identifi- 
cation for AmJ-L > at a baseline of 7332 km. Shown are the la and 2cr contour lines. 
The black rectangles denote the parameter pair for which the data were generated and the 
stars denote the best fit. The numbers next to the contour lines are x 2 P er % d.o.f values 
for the local minima of the same parameters, but with the wrong sign o/Am^. The global 
minimum is excluded in this case because its Am| x is already excluded. 



charge identification from the spectral data of the appearance channels. The solid lines 
are based on an analysis of the combined channels without charge identification. Charge 
separation capabilities which allow to use the statistically favored pure appearance channel 
are thus very important if sin 2 2# 13 turns out to be smaller than ~ 10~ 2 . 

From this discussion it seems clear that one should include charge identification. But there 
are other issues which may turn out to be equally important as the discussion of statistics 
and rates which was presented here. If, for example, right sign muon rejection (i.e. charge 
identification) turns out to be less good than hoped, or if there were background issues which 
make it hard or impossible to isolate correctly the wrong sign u e —>■ muon signal then our 
proposed method without charge identification should still work. Many of these issues are 



still under discussion [17], Ul To illustrate the requirements for charge identification 
assume 100,000 muon events in a detector (which corresponds roughly to a baseline of 
3000 km and a beam energy of 50 GeV with the usual beam and detector parameters) and 
right sign charge rejection of 10 , which would lead in average to 10 background events in 
the appearance channel which limits the ultimate sensitivity to sin 2 26 \% considerably. The 
problem can not be overcome by increasing statistics (i.e. by increasing N^N^e^) since the 
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Figure 7: Fit to t/ie muon neutrino spectrum with charge identification (i.e. — > and 
v e - ► channels separated) for Am^ > at a baseline of 7332 km. Shown are the la and 
2a contours. The rectangles denote the parameter pairs for which the data were generated 
and the stars denote the best fits. The numbers printed next to the contour lines are the 
local minima of x 2 V er % d.o.f with the same parameters, but the wrong sign o/Am^. The 
global minimum is excluded because its Am^ value is out of range. 



signal to background ratio stays constant. Any real detector may thus be limited by its right 
sign charge rejection capability and the number of right sign muons. This is also connected 
to the question which baseline should be used. The amount of background is typically 
directly proportional to the disappearance rates. This would favour larger baselines, since 
the disappearance rates drop faster than the appearance rates, improving the signal to 
background ratio for longer baselines. The decreased statistics in the sin 2 2^23 and jAm^l 
determination (with a precision of the order of a few percent) is not a problem since this 
will be limited by systematics and not statistics, even for the longest baselines. 



7 Conclusions 

We studied in this paper different possibilities to use matter effects to determine the value 
and the sign of Am^ and the magnitude of sin 2 2#i 3 in very long baseline experiments with 
neutrino factories. The analysis rests on the detection of muons coming from muon-neutrinos 
or antineutrinos and we distinguish detectors with and without right sign muon charge 
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Figure 8: Sensitivity to the sign of Am 2 . Shown are the la, 2a and 3a contour lines 
of a fit with the wrong sign of Am 2 . The dotted lines are based on spectral data from 
the appearance channel only. The solid lines use the combined data from the appearance 
and disappearance channels without separation of right and wrong sign muons. (7332 km, 
\Am 2 31 \ = 3.5 • 10" 3 eV 2 and iV>iV fcT e M = 2 ■ 10 21 j. 



rejection capabilities. This may be important since the v e — > and v e — > appearance 
channels have rather small total event rates and they require very good efficiencies for the 
detection of wrong sign muon events. Backgrounds due to charge misidentification play 
an especially important role for very small sin 2 2dy$ and at too short baselines, where the 
dominant non-oscillated neutrino rates are high. Studies of charge identification capabilities 
are presently performed [§, [T7|, [1^, [L9| . 

We discussed the relevant appearance and disappearance rates analytically and we per- 
formed numerical simulations which were used to test the parameter extraction from event 
rates in a statistical reliable way. Our results show for large baselines like 7332 km that 
there are matter effects of comparable size in the event rates in the v e — ► and v e —>■ z/ M 
appearance and in the — ► z/ M and —> disappearance channels. Matter effects in the 
disappearance channels alone are however statistically somewhat disfavored, since they have 
to be extracted from the relatively large amount of un-oscillated events. Without sufficient 
charge identification capabilities there is however still the advantage that matter effects 
in the combined muon rates resulting from and v^, i.e. generated from the combined 
appearance and disappearance channels, add in a constructive way. This allows a determi- 
nation of sin 2 2#i3 and the sign of Am\ x even without charge identification down to mixings 
sin 2 2#i3 = 10 _2 and with a precision comparable to the appearance channels with perfect 
charge separation. This new method allows thus to measure or limit the mixing sin 2 2#i3 
roughly one order of magnitude below the present CHOOZ limit. With charge identification 
one can get better results from the appearance channels alone. We pointed however out 
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that with charge identification the best results can be obtained by combining all information 
from the appearance and disappearance channels. In this case one can measure or limit the 
mixing down to sin 2 2# 13 ~ 10~ 4 . We gave exclusion plots which display the parameter range 
where a determination of the sign of the mass squared difference Am^ will be possible. 

Our results were obtained in the approximation where Am^ corrections are negligible which 
allowed an analytic description. In the limit Am^ = CP violating effects drop out and 
matter effects can be understood in an effective two neutrino scheme which is inserted into 
the full three neutrino oscillation formulae. It should however be stressed that there will be 
sizable corrections to this picture for shorter baselines if Am^ is at its upper limit. In this 
case the fit of Am^, sin 2 2# 13 and sin 2 2# 2 3 had to include in addition Am^ and the CP- 
phase 5. These extra Am^ 7^ effects become however much smaller for longer baselines, 
such that larger baselines are safer without loosing detection capabilities for matter effects. 
We did not discuss in more detail baseline and beam energy optimization since it depends 
on the preferred quantities, improvements on the knowledge of some parameters and the 
number of different baselines (i.e. beams and experiments) available. We mentioned however 
that a too short baseline could potentially also be dangerous if one neglects imperfect charge 
separation and other backgrounds. It seems therefore that larger baselines above 3000 km 
are also preferred from this point of view. We restricted our analysis therefore to a baseline 
of 7332 km which is very well suited for our study. We used a muon beam energy of 20 GeV, 
since it gives a spectrum centered around the resonance energy of matter effects in earth 
and which seems to be preferred by recent studies of entry level neutrino factories |TU . 
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